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Abstract 

We test recent claims that causal (driver /response) relationships 
can be deduced from interdependencies between simultaneously mea- 
sured time series. We apply two recently proposed interdependence 
measures which should give similar results as cross predictabilities 
used by previous authors. The systems which we study are asymmet- 
rically coupled simple models (Lorenz, Roessler, and Henon models), 
the couplings being such as to lead to generalized synchronization. If 
the data were perfect (noisefree, infinitely long), we should be able 
to detect, at least in some cases, which of the coupled systems is the 
driver and which the response. This might no longer be true if the 
time series has finite length. Instead, estimated interdependencies de- 
pend strongly on which of the systems has a higher effective dimension 
at the typical neighborhood sizes used to estimate them, and causal re- 
lationships are more difficult to detect. We also show that slightly 
different variants of the interdependence measure can have quite dif- 
ferent sensitivities. 
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1 Introduction 



The study of synchronization between chaotic systems has been a topic of 
increasing interest since the beginnings of the '90s. One important step in this 
direction was the introduction of the concept of generalized synchronization 
[0? !> Hi) extending previous studies of coupled identical systems (identical 
synchronization || ^ ^ [7], ||, |!|) to the study of coupled systems with different 
dynamics. 

Let us denote by X and Y two dynamical systems, and by x = {x±, . . . , Xd} 
and y = {yi, . . . , y r } their state vectors, obtained for example by delay em- 
bedding. We assume in the following that the dynamics is deterministic 
with continuous time (the case of maps is completely analogous, and will be 
treated in Sees. 3 and 4). We further assume the systems are unidirectionally 
coupled, say X is the autonomous driver and Y the driven response 

x(t) = F(x(t)), 

y(t) = G(y(t),x(t)) (1) 

We speak about generalized synchronization between X and Y if the 
following relation exists: 

y(*) = *(*(*)) (2) 

This requirement is less restrictive than the one of identical synchronization, 
in which \I> = 1 . Equation (fj) implies that the state of the response system is 
a function only of the state of the driver. It is not to be confused with the op- 
posite relation x(t) = $(y(t)) (considered in [ICfl), which is generically valid 



for sufficiently high embedding dimensions if the coupling is non-singular, in 
the sense of obeying det(dGi/dx n ) ^ everywhere. This follows from the 
implicit function theorem, which allows us to invert eq.(|l]b) to x = x{yiY)i 
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and from the fact that y(t) = (y(t),y(t)) is as good a state vector as y(t). In 
particular, if we consider G(y(t), x(i)) = H(y(t)) + U(x(t)), we immediately 
have x(£) = £/ _1 (y(t) — H(y(t))) if U(x) can be inverted. 

The transformation \1/ does not need to be smooth as considered in [||, [IT 



and explicitly required in [12, [Tj|. In fact, Pyragas [14] defined as strong and 
week synchronizations the cases of smooth and non-smooth transformations, 
respectively (see also fl5|| ). 

If one of the systems drives the other and a relationship like equation (0) 
exists, it is possible to predict the response from the simultaneous state of 
the driver. But the opposite is not true. Just knowing that a relationship 
like equation (||]) exists and that the state of Y can be predicted from that of 
X, it is in general not possible to establish which is the driver and which is 
the response. This is obvious when \1/ is bijective (i.e., $ = exists and is 
unique). The above arguments tell us that \l/ is indeed likely to be bijective 
in case of generalized synchronization, at least for nearly all x: If a coupling 
is not regular in the above sense, then its singularities are typically located 
on a set of measure zero. One might tend to believe that X must control Y 
(and not the opposite), if y follows the motion of x with a positive time delay. 
But even then one cannot be sure since there could be an internal delay loop 
in Y which causes the emitted time series to lag behind. Also, both systems 
could be driven by a third system. Thus, detecting causal relationships is 
not easy in general, although it is of course of utmost importance in many 
applications. 

In the above we pretended that we could detect exactly whether the state 
of one of the systems is a function of the other. This is of course never 
the case in practical applications. Different observables which should enable 
one to detect interdependencies in realistic cases were introduced by several 
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authors. Following an original idea of Rulkov et al. B O], mutual cross- 



predictabilities were defined and studied by Schiff et al. |L7| and Le van Quyen 
et al. |L6|, [10| . A quantity more closely related to that of ||, but optimized 
for robustness to noise and imperfections in the data was used in ||18|| . In the 
latter paper also a number of other variants were discussed. Some of these 
variants were tested and found to be inferior, but no systematic tests were 
made. 



In contrast to our above discussion, the authors of 17 and [[Lq, uM claimed 



that driver /response relationships can be deduced from such interdependen- 
cies. But their proposals, backed by numerical studies of simple model sys- 
tems, were mutually contradictory. While it was argued in |l7j that the 
driver state x should be more dependent on the response state y (i.e., there 
exists a stronger functional dependency y x) than vice versa (which is, as 
we said, a bit counter intuitive), exactly the opposite was claimed in fl6|, [Tcfl . 



Finally, in |18| it was claimed that neither can be expected to be correct in 
realistic situations with finite noisy data, and that it is in general the system 
with more excited degrees of freedom (the more 'active' system) that is more 
independent, while the state of the more 'passive' system (with less excited 
degrees of freedom) depends on it. 

It is the purpose of the present work to settle this question by carefully 
studying simple toy models, including Lorenz, Roessler, and Henon systems, 
using two of the interdependence measures proposed in [[18]. Basic notions 
involved in generalized synchronization are reviewed in Sec. 2. In Sec. 3, we 



recall the operational definition of interdependence used in ||18|| . Numerical 
results are presented in Sec. 4, and our conclusion is drawn in Sec. 5. 
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2 Generalized Synchronization with Exactly 
Known Dynamics 



While identical synchronization is easily visualized by plotting the difference 
between one of the coordinates of the driver and the corresponding coor- 
dinate of the response, no similarly simple way exists to detect generalized 
synchronization. Constructing the function \l/ explicitly might be possi- 
ble in particularly simple cases, but since this will be never exact, it will be 
never clear whether deviations from eq.(2) are due to lack of synchronization 
or inexactness of Instead, the methods of choice in cases where the exact 
equations of motion are known and where arbitrary initial states can be pre- 
pared are the study of Lyapunov exponents and the identical synchronization 
of two identical response systems differing in their initial conditions. 

For the driver /response systems as in eq.(l), one has d + r different Lya- 
punov exponents. Of these, d exponents coincide with those of the (au- 
tonomous) driver denoted by X\ , i = 1 . . . d. The other r exponents co- 
incide with those of the response, considered as a non-autonomous system 
driven by the external signal x(t) (called conditional Lyapunov exponents in 
H) []. They will be called A) , i — 1 . . . r. Ranking the Lyapunov exponents 

(Y) 

as usual by magnitude, we have generalized synchronization iff A^ < 0. 

Furthermore, once the Lyapunov exponents are known, the dimension of 
the combined system X+ Y can be estimated from the Kaplan- Yorke formula 
1 To see this, we have to recall that all Lyapunov exponents are obtained by iterating 

d+r basis vectors in tangent space, and re-orthogonalize them repeatedly. Tangent vectors 
fx") 

corresponding to A) span only the first d coordinates. The remaining tangent vectors 
have the first d components equal to zero, either by orthogonalization or because their last 
r components increase faster than any of the first d components. 
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m 

^x +Y = / + E^ (3) 

(here, I is the largest integer for which the sum over j is non negative). 

Generically, we must expect this also to be the dimension of Y alone The 

reason is that, as pointed out in the introduction, X will be a (single- or 

multivalued) function of Y, if the inverse of G(x, y) is single- or multivalued. 

On the other hand, the Kaplan- Yorke dimension of X alone may be equal 

to Dx+y or smaller. It is given by a formula similar to eq.(f|) but with A» 
fx) 

replaced by A- . We see that 

Cx<5x + Y iff X^>\\+1 (4) 

(X) fX) 

where I is determined by J2j<iXj < < J2j<i+i A} . If this inequality 

fYl 

holds (together with X\ < 0), we have weak synchronization in the sense 
of Pyragas |TJ]]. In the opposite case, i.e. Ap^ < Affi, one is likely to have 
strong synchronization, although this might not be true due to multifractal- 
ity: Due to the latter, it is possible that the box-counting dimension of X 
is strictly smaller than that of X + Y, although the equality holds for the 
Kaplan- Yorke (i.e., information) dimensions. In such \l/ cannot be 

smooth, but regions where \1/ is non-smooth might well be of measure zero 

[0- 

Another approach for detecting generalized synchronization is by using 
two identical response systems which differ only in their initial conditions. 
If these replicas get synchronized after some transient, their trajectories are 
obviously independent of the initial conditions, thus being only a function of 
the driver. This is most easily checked visually, e.g. by plotting the difference 
2 I.e., the dimension of an attractor constructed exclusively from components of y; we 
keep of course the fact that Y is driven by X. 
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between two analogous components of the two replicas against time. In this 
way one can also check for intermittencies and long transients which can, 
together with finite numerical resolution, severely obscure the interpretation. 



3 Generalized Synchronization in Real Life 

The above considerations depend on the availability of the exact equations 
of motion, and on the ability to prepare identical replicas. Neither holds for 
typical applications. 

Real signals usually consist of short segments of data contaminated by 
noise. Furthermore, the dynamics of the system is not known, and therefore 
the methods described in the previous section are not applicable. 

While identically synchronized systems describe the same trajectory in 
the phase space, the hallmark of a relationship as in eq.(2) is that any recur- 
rence of X implies a recurrence of Y. If X comes exactly back to a state it 
had already been in before, the same must be true for Y. In real data, one 
cannot of course expect exact recurrence. We will therefore use as a criterion 
that whenever two states of X are similar, the contemporary states of Y are 
also similar. 

In \ 17\ , [16 , [Hj, this was implemented by making forecasts of x n using 



local neighborhoods (e.g., by means of locally linear maps), and comparing 
the quality of these forecasts with that of forecasts based on "wrong" neigh- 
borhoods. In the latter, the nearest neighbors of x„ are replaced by the equal 
time partners of the nearest neighbors of y n . For reasons explained in JTj], 
we prefer to use instead a measure closer to the original proposal of Rulkov 
et al. . But we should stress that we see no reason why our results should 
not be carried over to the observables used in [[17], [L(| [HJ immediately. 
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Let us suppose we have two simultaneously measured univariate time 
series from which we can reconstruct m-dimensional delay vectors |^TJ x n = 
[x n , . . . , x n _ m+ i) and y ra = [y n , . . . , y n _ m+ i), n = 1, . . . N. 

Let r n j and s n j, j = l,...,k, denote the time indices of the k near- 
est neighbors of x n and y n , respectively For each x n , the squared mean 
Euclidean distance to its k neighbors is defined as 

^ ) (X) = ^E(x n -x rn , j ) 2 (5) 

and the Y- conditioned squared mean Euclidean distance is defined by replac- 
ing the nearest neighbors by the equal time partners of the closest neighbors 
of y„, 

^ fc) (X|Y) = i£(x n -x^) 2 . (6) 

If the point cloud {x n } has average squared radius R(X) = (R^-^iX)) 
and effective dimension D (for a stochastic time series embedded in m di- 
mensions, -D = m), then i?^(X) <C RfiQ for fc C More precisely, we 
expect 

J#>(X)/J2(X) ~ (A;/iV) 2 ^, (7) 

where .D is the dimension of the probability measure from which the points 
x„ are drawn. Furthermore, R^'(X.\Y) rs /^(X) <C -R(X) if the systems 
are strongly correlated, while R^(X.\Y) 3> R^(K) if they are independent. 
Accordingly, we can define an interdependence measure 5^(X|Y) as 

sW(xiy) ^sJS) (s) 

Since R^(X.\Y) > R^(X.) by construction, we have 

< S (fc) (X|Y) < i. (9) 



Low values of iSW(X|Y) indicate independence between X and Y, while high 
values indicate synchronization (becoming maximal when ^^(XIY) — > 1). 

The opposite interdependence S^^YIX) is defined in complete analogy. 
It is in general not equal to SW(X|Y). If S( fc )(X|Y) > 5^(Y|X), i.e. if X 
depends more on Y than vice versa, instead of assuming a causal relation- 
ship, we just say that Y is more "active" than X. As was argued in 



high activity is mainly due to a large effective dimension D, on the typical 
length scale set by the distances |x n — x r . n k | and |x n — x Sn J. 

The second interdependence measure to be used in this work was also 
introduced in ||18|| . In eq.(||) we essentially compare the Y-conditioned mean 
squared distances to the unconditioned m.s. nearest neighbor distances. In- 
stead of this, we could have compared the former to the m.s. distances to 
random points, -R n (X) = (N — l)^ 1 X^ n (x n — x^) 2 . Also, in ergodic theory 
often geometric averages are more robust and more easy to interpret than 
arithmetic ones. Therefore, let us use the geometrical average in the analogon 
of eq. (H) , and define 

( fc )(X|Y) = 1 V log f" (X) (10) 

This is zero if X and Y are completely independent, while it is positive if 
nearness in Y implies also nearness in X for equal time partners. It would 
be negative if close pairs in Y would correspond mainly to distant pairs 
in X. This is very unlikely but not impossible. Therefore, if( fc )(X|Y) = 
suggests that X and Y are independent, but does not prove it. This 
(and the asymmetry under the exchange X <-> Y) is the main difference 
between i/( fc )(X|Y) and mutual information. The latter is strictly positive 
whenever X and Y are not completely independent. As a consequence, 
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mutual information is quadratic in the correlation P(X, Y) — P(X)P(Y) for 
weak correlations (P are here probability distributions), while p( fc )(X|Y) is 
linear. Thus P"( fc )(X|Y) is more sensitive to weak dependencies which might 
make it useful in applications. Also, it should be easier to estimate than 
mutual informations which are notoriously hard to estimate reliably. 



4 Numerical Examples 

The aim of this section is to see numerically whether there exists any relation- 
ship between the 'activity' defined in the last section, and a driver/response 
relationship. In principle there should exist such a relationship, since we have 
argued that the system with higher dimension should be more active, and 
usually the response does have higher dimension. This would agree with the 
conclusion of [DJ , and contradict |16|, [K| . But it is well known that observed 



attractor dimensions can be quite different from real ones, in particular if 
one has only a finite amount of noisy data and weakly coupled systems [|22|]. 



In order to obtain results which can be easily compared to those of [17 



T6|, pi, we study the same systems as these authors. 



4.1 Lorenz Driven by Rossler 

As a first example, we studied the unidirectionally coupled systems proposed 
in reference (TD| . The driver is an autonomous Rossler system with equations: 

±\ = -a{x 2 + x 3 } 

x 2 = a{xi + 0.2 x 2 } (11) 
±3 = a{0.2 + x 3 (xi — 5.7)} 
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which drives a Lorenz system in which the equation for y 2 is augmented by 
a driving term involving x 2 , 



ill = l0(-yi + y 2 ) 

y 2 = 28 yi -y 2 - yi y 3 + C x 2 2 (12) 
8 

2/3 = 2/1 2/2 — gJ/3- 

The unidirectional coupling is introduced in the last term of the second 
equation, the constant C being its strength. Notice that x 2 enters quadrat- 
ically in the coupling, whence it cannot be written as a univalent function 
°f 2/ij 2/2, 2/3, and y 2 . Thus we do not have a strict argument telling us that 
Dy > -Dx, but the latter seems extremely likely. 

As in reference |Hj the parameter a is introduced in order to control the 



relative frequencies between the two systems. The differential equations were 
iterated, together with the equations for the tangent vectors, by using fourth 
and fifth order Runge-Kutta algorithms with At = 0.003 — 0.009. This was 
checked to yield numerically stable results, while larger At and/or a third 
order algorithm would have given different results. In order to eliminate 
transients, the first 10 6 iterations were discarded. From the increase of the 
tangent vectors during the following 10 6 iterations we obtained the Lyapunov 
exponents. Delay vectors with delay r = 0.3 and embedding dimensions 
4 and 5 were constructed from x\(t) and yi{t). This delay corresponds to 
roughly 1/4 of the average period of the Lorenz equations. All time sequences 
had length N = 5000. In order to check for stability and for very long 
transients, all computations were repeated several times with different initial 
conditions. 

For the parameters considered here, the Lyapunov exponents of the Rossler 
are Aj ~ 0.09a, 0, —5a; and the ones of the Lorenz without coupling are 
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Aj ~ 0.84, 0, —14.5. Figure [I] shows the maximum Lyapunov exponent of 
the driven Lorenz system, as a function of the coupling strength C. The 
continuous curve shows the result for a = 6, the broken one corresponds to 
a = 10. For generalized synchronization, the maximum Lyapunov exponent 
should be negative. When a = 10, this is observed for 2.1 < C < 2.7 and 
for c > 2.9. For all values of C considered in fig. p], the maximal Lyapunov 
exponent of the driven system is larger than the smallest one of the driver, 
and therefore we have only weak synchronization. 

Figure || shows the interdependencies if>(X|Y), 5(Y|X), H(X.\Y) and 
ff(Y|X) for a = 6 and a = 10, and for different number of nearest neighbors. 
The embedding dimension was m = 5. In all panels, lines with crosses (lower 
curves) are for S and lines with squares (upper curves) are for H; the dark 
lines denote (Y|X) interdependencies and the grey lines are for (X|Y). All 
interdependencies rise with the coupling strength, with only few exceptions. 
These exceptions (at C ~ 2.5 for a = 6 and at 2.3 < C < 2.8 for a = 10) 
occur exactly at places where the maximal Lyapunov exponent of the driven 
system is non-monotonic. Thus the dependencies are monotonic functions of 
the Lyapunov exponent. The measure S is more sensitive to the sign of the 
Lyapunov exponent than is H, as seen from the sharper increase of S when 
the Lyapunov exponent passes through zero and the systems synchronize. 

In reference QTOj this system was studied only for a = 6 and C — 8. The 
latter corresponds to very strong coupling. It was found that the interde- 
pendence of Y from X was larger than vice versa. This was taken as a proof 
that in general the response depends more on the driver than vice versa, and 
it was proposed that this result could be used as a general method to detect 
driver /response relations. 



Our results with S and H agree perfectly with those of 10 , if we keep 
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the same values for a and C, and use k > 20, i.e. for large neighborhoods. 
In case of S we find if>(Y|X) > 5"(X|Y) for all k and a, provided C > 
5. Finally, we also find the same inequality if>(Y|X) > 5(X|Y) for very 
small couplings (below the synchronization threshold), while the opposite 
inequality sometimes holds for intermediate C. 

A more consistent picture is seen in the behavior of if (X|Y) and if (Y|X). 
Except in the case a = 6, C > 4, and k > 20, we always found if (X|Y) > 
if (Y|X), in agreement with the prediction of [17]]. This inequality is most 
pronounced for small values of C. 

Our results can be understood by the following heuristic arguments: 

• For strong couplings the two systems are so strongly synchronized that 
the differences in interdependence are small, and we can predict X from 
Y essentially as well as Y from X. 

• The theoretical predictions if (X|Y) > H(Y\X) and S(X\Y) > S(Y\X) 
are based on the limiting behavior for small neighborhoods. It is thus 
not too surprising that they can be violated for large values of k. 

• For uncoupled systems (C = 0) one has S'(XIY) < 5(Y|X) if Dx < 
Dy and vice versa. Notice that this (which is easily obtained from 
eq.([7j) is the opposite of what we expect if Dx < Dy holds only due 
to the coupling. In our case, -DR oess i er rs 2.018 < -DLorcnz ~ 2.058. This 
explains why 5"(X|Y) < 5(Y|X) for very small C (C < 1). In con- 
trast, if (X|Y) = if (Y|X) = for uncoupled systems, whence no such 
problem exists for ff. Thus we expect that the behavior of if(X|Y) 
at small couplings is easier to interpret than the behavior of S which 
should depend nontrivially on k and N. This is precisely what we 
found. 
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4.2 Two Coupled Henon Maps 

As a second example we studied two unidirectionally coupled Henon maps 
similar to the ones proposed in |T7[, with equations 



x[ = 1.4 — x\ + b\ x 2 

x' 2 = xi (13) 



for the driver, and 



y[ = lA-(Cx 1 y 1 + (l-C)y 2 1 ) + b 2 y 2 

V2 = yi (14) 

for the response. Again we discarded the first 10 6 iterations, and obtained 
Lyapunov exponents from the next 10 6 . Inter dependencies were then esti- 
mated from N = 5000 iterations, using 3-dimensional delay vectors. As in 
the previous example, the stability of the results was checked by starting 
from different initial conditions. For calculating the interdependencies we 
used k — 10 nearest neighbors. No significant changes were observed for 
other values of k. 

The constants b\ and b 2 were both set to 0.3 when analyzing identical 
systems, and to 0.3, 0.1 when analyzing non-identical ones. Furthermore, in 
all cases we also studied how the results changed if white measurement noise 
was added either to the driver, to the response, or to both. 

4.2.1 Identical systems 

We first studied the case b\ = b 2 = 0.3. This is the "canonical" value for 
the Henon map, for which Ai = 0.4192 and D = 1.26. One easily sees that 
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(yi,V2) = (^1,^2) is a solution of eqs.([T3|,|I4|). Thus we can have identical 
synchronization ||, but due to the asymmetry of the coupling we cannot 
rule out non-identical (generalized) synchronization either. 

Figure |3| (solid line) shows the maximum Lyapunov exponent of the re- 
sponse system. It becomes negative for couplings larger than 0.7, when iden- 
tical synchronization between the systems takes place. But it is also slightly 
negative for 0.47 < C < 0.52. Plotting differences x\ — y±, e.g., one sees 
that there is no identical synchronization in this window. But making a cut 
through the attractor of the combined system, by plotting e.g. pairs (£2? 2/2) 
whenever \xi\ < 10 -4 , one sees a fractal structure which clearly shows that 
there is no identical synchronization. On the other hand, < which 
leaves only the possibility of generalized synchronization. In this window 
(0.47 < C < 0.52), the Kaplan- Yorke formula gives D 2.25, showing that 
this synchronization is weak. For C > 0.7, the Kaplan- Yorke formula does 
of course not apply to the combined system and D = D}i enon = 1.26. 

Interdependencies are shown in fig. [|A and fig. ^D. As expected, we see 
that S and H both rise sharply at C > 0.7, where identical synchronization 
sets in. The fact that synchronization is perfect is seen from the fact that 
5(Y|X) = 1 for C > 0.7. In contrast, we do not see any anomaly for C ~ 0.5, 
showing again that the synchronization at c ~ 0.5 is very weak indeed. For 
C < 0.7 we see that H(X.\Y) > H(Y\X.), in agreement with our general 
prejudice that the response has higher dimension and is thus more active. 
Although not so pronounced, this difference is also seen for S. 

We also analyzed how both measures changed with the inclusion of mea- 
surement noise (S/N amplitude ratio ~ 25%). Figs. |]B and 4E show the 
results when the noise is added to the driver and figs.|]C and 4F when it is 
added to the response. In general, we expect of course a decrease of any de- 
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pendences when noise is added. Formally, we have to discuss how (X|Y) , 
R^(Y\X), RW(X), and R(X) change if noise is added to X. 

• R(X) changes very little, since S/N <C 1; 

• R^ (X) increases strongly, since the dimension of the noisy time series 
is large; 

• R( k \X\Y) increases little if X and Y are weakly dependent (it is al- 
ready large), but increases even more than R^ k \X) if X and Y are 
strongly dependent. 

• The last is also true for R {k) (Y\X). 

From these we see that H(Y\X) should decrease roughly as much as 
H(X\Y), and this decrease should be strongest if X and Y are fully syn- 
chronized. In contrast, S'(XIY) should decrease much less (or even increase) 
if noise is added to X, and if X and Y are weakly dependent. If X and 
Y are fully synchronized, adding noise to X suppresses if>(Y|X) much more 
than 5(X|Y) since the strong increase of R^ k \Y\X) is then not compensated 
by any change of -R(Y). Adding noise to Y can be discussed similarly. All 
these predictions are fully verified in fig. 4. Notice that measurement noise 
can reverse the general inequality H (driver | response) > H (response) driver), 
as seen e.g. in fig.^E for C > 0.7. 

In general, S seems to be less robust against measurement noise than H. 

4.2.2 Non identical systems 

Figures [|A and 5D show dependencies for different 6-parameters (b\ = 0.3, b 2 = 
0.1) where identical synchronization is impossible, and where the driver has 
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higher dimension than the uncoupled response. In this case, the interdepen- 
dences do not increase as sharply as in the previous case, and they reach 
lower values. With both measures we see an increase between C = 0.1 — 0.4 
in agreement with the negative values of the maximum Lyapunov expo- 



nent for these coupling strengths (see fig {J). As in reference [17], we found 
5(X|Y) > 5(Y|X) and #(X|Y) > H(Y\X). These inequalities still hold 
when adding measurement noise to the driver (fig.E|B,E). But when the noise 
is added to the response (fig.|]C,F), only the inequality for H survives, while 
that for S is reversed. These dependences on noise can be discussed in com- 
plete analogy with the previous case of identical systems. 

The situation changes slightly if the uncoupled response has higher di- 
mension than the driver, as in the case b\ = 0.1, 62 = 0.3 shown in fig. ^. The 
panels of this figure show more structure than those of fig.|5|, mainly since also 
the Lyapunov exponent shows more structure (see fig|f). From fig. |^F we see 
that there is a parameter window, 0.4 < C < 0.6, where if (Y|X) > H(K\Y) 
after adding noise to Y. This is not yet understood, but all other features 
in this plot can be understood heuristically along the lines discussed above. 

5 Conclusion 

In this work we studied the possibility of predicting driver/response rela- 
tionships from asymmetries in nonlinear interdependence measures. More 
precisely, we studied two particular interdependence measures, introduced in 
[ |I~8|j , and applied them to simple asymmetrically coupled strange attractors. 
In contrast to previous works, we find that such predictions are not always 



reliable, although we agree with [17| that they would be possible for ideal 



(noise-free, infinitely long) data. We agree with [|1^, |10[ as far as one of 
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their numerical examples is concerned, but we show that this was a mere 
coincidence, and cannot be generalized. 



Instead, we confirmed the conjecture of |18j that asymmetries in interde- 
pendence measures reflect mainly the different degrees of complexity of the 
two systems at the level of resolution at which these measures are most sen- 
sitive. For practical applications, this is not the infinitely fine level at which 
theoretical arguments like those of |I7j apply. The latter predict correctly 
that the response is more complex, i.e. has a higher Kaplan- Yorke dimension. 
But this argument can become irrelevant even for the extremely simple toy 
models which we studied in the present paper. It should be even less relevant 
in realistic situations where all sorts of noise, non-stationarity, and shortness 
of data present additional limitations. 

Nevertheless, we propose that asymmetries of measured interdependen- 
cies can be very useful in understanding coupled systems. Indications for this 



were given in [17, 16, O, ffq]. All these papers were dealing with neurophysi- 



ology. Even if no causal relationships can be deduced from such asymmetries, 
it was found in [[U], [10], [18] that the resulting patterns are closely related to 
clinical observations, and could e.g. contribute to a more precise localization 
of epileptic foci and might be useful for predicting epileptic seizures. 

An unexpected result of our study is that for the simulations performed 
the measure i7(X|Y) which had not done very well in preliminary tests is 
actually more robust and easier to interpret than the measure S'(XIY) which 



was mostly used in [jig] . However, this should not be directly extended to 
real life data. A more systematic comparative study with a large database 
of EEGs from epilepsy patients is under way. 
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012345678 
coupling strength C 

Figure 1: Maximum Lyapunov exponents of the modified Lorenz system 
driven by a Rossler. The continuous curve is for a — 6, the broken for 
a = 10. 
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Figure 2: Non-linear interdependences between a Lorenz system driven by 
a Rossler system, plotted as a function of the coupling strength. Left side 
graphs correspond to a = 6 and right side graphs to a = 10. From top to 
bottom, the graphs are for 10, 20, and 30 nearest neighbors. 5(Y|X): black 
lines with crosses, S'(XIY): grey lines with crosses, if(Y|X): black lines 
with squares and H(K\Y): grey lines with squares. See text for details. 




Figure 3: Maximum Lyapunov exponent of the response system for two 
coupled Henon systems with bi = b 2 = 0.3 (solid line); b x = 0.3, b 2 = 0.1 
(dashed line); and bi = 0.1, b 2 = 0.3 (dotted line). 
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Coupling strength 



Figure 4: Interdependencies between two Henon systems with equal b- 
parameter, b\ = 62 = 0.3 as functions of the coupling strength (panels A 
and D). In the other panels, white measurement noise has been added either 
to the driver (panels B, E) or to the response (panels C, F). Left side figures 
correspond to S and the ones in the right side to H. Black lines are the 
(Y|X) interdependencies and grey lines correspond to (X|Y). 
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Coupling strength 



Figure 5: Same as fig.|], with bi = 0.3, b 2 = 0.1 
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A D 




Coupling strength 



Figure 6: Same as fig.|] with b\ = 0.1, 62 = 0.3. In panel C, the curve for 
5(X|Y) coincides with the x-axis within our precision. 
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